Adaptive Random Walks on the Class of Web Graphs 



Bosiljka Tadic* 
Jozef Stefan Institute, P.O. Box 3000, 1001 Ljubljana, Slovenia 

We study random walk with adaptive move strategies on a class of directed graphs with variable 
wiring diagram. The graphs are grown from the evolution rules compatible with the dynamics of the 
world-wide Web [Tadic, Physica A 293, 273 (2001)], and are characterized by a pair of power-law 
distributions of out- and in-degree for each value of the parameter {3, which measures the degree of 
rewiring in the graph. The walker adapts its move strategy according to locally available information 
both on out-degree of the visited node and in-degree of target node. A standard random walk, on the 
other hand, uses the out-degree only. We compute the distribution of connected subgraphs visited 
by an ensemble of walkers, the average access time and survival probability of the walks. We discuss 
these properties of the walk dynamics relative to the changes in the global graph structure when the 
control parameter j3 is varied. For /3 > 3, corresponding to the world-wide Web, the access time of 
the walk to a given level of hierarchy on the graph is much shorter compared to the standard random 
walk on the same graph. By reducing the amount of rewiring towards rigidity limit (3 —> ^ 0.1, 
corresponding to the range of naturally occurring biochemical networks, the survival probability of 
adaptive and standard random walk become increasingly similar. The adaptive random walk can 
be used as an efficient message-passing algorithm on this class of graphs for large degree of rewiring. 



I. INTRODUCTION 

It has been recognized recently that the key role in the 
dynamics of complex systems is played by the evolving 
networks of various structures |^J^ . Evolution of complex 
networks representing catalytic reactions, cell metabolic 
processes, relaxation in disordered systems, protein fold- 
ing, and realistic ecological, social, and information net- 
works iQ-H are guided by variety of principles inherent 
to each particular network. Technically, the study of the 
evolving networks includes theory of graphs, as opposed 
to regular lattices, which are appropriate mathematical 
objects in the study of driven cellular automata with dif- 
fusive dynamics Both, the dynamics of nodes and 
arcs (links) contribute to the evolution of the network. 
Thus, network growth implies that a complex architec- 
ture of links emerges, which is peculiar to the network, 
as an effect of the individual microscopic rules at work. 

Many complex networks self-organize into a scale-free 
structures of links (for a recent review see |^ ) . The ap- 
pearance of a scale- free structure is not accidental, having 
that networks grow from stochastic rules, that assumes 
certain degree of disorder on the microscopic scale. This 
rules result in the occurrence of dynamic fractal struc- 
tures on the growth time-scale which is then mani- 
fested in the emergent hierarchical organization of node 
degrees at large evolution times. In growing networks the 
preference attachment such as in socially motivated link- 
ing, e.g., in science citation network [Q, was shown to be 
one of dominant mechanisms ]rT[ | leading to the scale- free 
structure of links PJT^. However, in many other growing 
networks the preference attachment alone has no capac- 
ity to take into account the intimate relationship between 
structural complexity of the networks and their evolu- 



tion. This implies dynamically changing wiring diagram, 
in sharp contrast to the rigid link structure in the sci- 
ence citation network, for example. Here we concentrate 
on this type of networks with the world-wide Web as a 
prominent example, in which constantly updated links 
yield rapidly changing wiring diagram p],p^. 

On the other hand, the occurrence of various uni- 
versality classes — characterized by the same scaling 
exponents — suggests that only certain details of the mi- 
croscopic dynamics are relevant for the universal scaling 
behavior of complex networks, in analogy to critical be- 
havior in physical systems in equilibrium |l3| . Although 
the theoretical background of the universality in complex 
dynamic systems and networks is still missing, numerical 
simulations on specific models and master equation 
calculations [l^-p^ suggest that the following local prop- 
erties (alone or in the appropriate combinations) of the 
dynamics are relevant for the emergent universal behav- 
ior: (a) Directed vs symmetric links (looked from a node 
in the network); (b) Fixed vs variable wiring diagram and 
time scale of its variations compared to the growth time 
scale; (c) Type of preference linking; and (d) Presence of 
constraints in the microscopic growth rules |18|. 

Recently we have introduced a model of growing di- 
rected graph with bias updates and biased attachment 
of links, motivated by the conduct of agents in the real 
world-wide Web [Q. It was shown that the model cap- 
tures minimum relevant properties for the dynamics of 
the Web, leading to a satisfactory quantitative compari- 
son of the universal scaling quantities with the ones mea- 
sured in the real Web Q . The relevant control parameter 
of the model f3, defined as the average ratio of updated 
and added links per time step (thus measuring the degree 
of rewiring in the graph) can vary in the range (0, oo). 
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The dynamic processes such as random walk specifi- 
caUy designed to the Web graphs reveal important in- 
formation on network's relaxation upon triggering and 
suggest how these networks can be efficiently explored. 
In Ref. |l| we introduced a random walk with adaptive 
walk strategy, that utilizes the locally available informa- 
tion on the underlying graph structure. In previous works 
| pO| , p^ we have discussed the structure and dynamics of 
the world-wide Web, representing a directed graph in this 
class with rapidly changing wiring diagram: Estimated 
pO| value of /3 3 — 4 from the scaling agreement with 
the observed behavior 

In this work we extend the study to the entire class 
of graphs generated by varying the control parameter (3 
in the physical range (0, oo). In the limit of extreme 
rewiring (/3 oo) some of the scaling features of the class 
disappear. On the other end, for fi f3c{N) ^0.1 the 
graph undergoes a rigidity transition, where majority of 
links in the graph remains fixed in time. Among the net- 
works between these two limits are the world-wide Web 
and networks representing a potential range of naturally 
occurring metabolic networks and catalytic reactions in 
open environment Specifically, we study (1) how the 
global graph structure varies with the control parameter 
f3 in the entire range before the rigidity transition, and 
(2) how these structural properties influence the relax- 
ation of the network and the dynamics of the random 
walk with variable walk strategies. In addition, study 
of the random-walk dynamics reveal how the local clus- 
ters participate in the global behavior of the graph. Wc 
briefly discuss the potential application of the random- 
walk path in communication processes on these class of 
graphs. 

The organization of the paper is as follows: In Sec. II 
we present the growth rules of the class of Web graphs. 
We grow large networks of 5 x 10^ nodes to determine the 
distributions of out- and in-degree for the range of val- 
ues of the control parameter /?. In Sec. Ill we define the 
adaptive random walk on this class of graphs and study 
the structure of connected subgraphs scanned by an en- 
semble of such walkers, which we then compare with the 
statistics of a standard random walk on the same graphs. 
In Sec. IV we determine the survival probability distribu- 
tion of these two types of random walk and their access 
time to a given hierarchy level. Sec. V is devoted to a 
short summary and conclusions. 



II. GROWTH AND STRUCTURE OF THE WEB 
GRAPH 

A directed Web graph is grown from the dynamic rules 
proposed in Ref. jl^, which are based on the criteria 
(a)-(c) listed above. (Potential effects of aging and other 
constraints on the microscopic dynamic rules are left out 
of this work) . A growth step is defined by adding a node 



and subsequently creating and/or removing links in the 
entire network, that results in total increment M{t) links 
at time step t — i. Naturally, we take M = M(t) > 0, 
suggesting that, in the average, the number of links in- 
crease at each time step. The links are updated in the 
following way. An outgoing link originates from a node 
n < i with the probability 



Pi{n,i) 



aM + qout{n,i) 
(1 + a)M * i 



(1) 



which is determined by the number of outgoing links 
<lout{n, i) previously created at that node. The link points 
towards the node k < i with the probability 



aM + qinjk, i) 
(1 + a)M * i 



(2) 



where qin{k,i) is the current number of incoming links 
collected at target node up to the step i. It is as- 
sumed that at the time of addition of a node i to the 
network qout{i,i) = qin{i,i) = 0. In addition a frac- 
tion /o(i) = aM{t) of new links are outgoing links from 
the new added node i — t. Whereas the remaining 
fi{t) = (1 — a)M{t) links are the updated links at preex- 
isting nodes in the network. Hence, the relevant param- 
eter in the model is the ratio of updated and added links 
at each time step, i.e., (3 = fi{t)/fo{t) — (! — «)/«, (inde- 
pendent of the actual increment M{t)), which measures 
the degree of rewiring (or flexibility) of the graph. The 
Eqs. (||)-(||) are motivated by the conduct of the agents 
who create links in the real Web: A new link is is likely 
to be created by the most active agents in the network, 
and, similarly, the most probable target node will be the 
one that already attracted many links. For consistency, 
we use M = 1 throughout this work 

The numerical simulations in Ref. [|10| demonstrated 
that the rules in Eqs. (|l|)-(||) are compatible with the ob- 
served scaling behavior of the real Web, when the single 
control parameter f3 is set to a given value /3 « 3, cor- 
responding to a w 0.2 within estimated error bars. The 
dynamically emerging out- and in-degree cumulative dis- 
tributions are given by the power-law functions 



(3) 



in the asymptotic region for large number of links (i.e., 
large networks). The distributions are given in Fig. 1 
for various values of the control parameter, showing the 
a-dependent scaling exponents Tout and Ti„. 

The asymptotic scaling behavior of the in-degree dis- 
tribution that is generated by the shifted-linear prefer- 
ence rule in Eq. (^ with Ti„ = 2 -t- a was proved ex- 
actly in Ref. jl4j , that agrees completely with our results 
in Fig. 1. Recently, a similar analysis using rate equa- 
tion approach was done in Ref. p6[ | for a directed graph 
in which in addition the probability of creating a link 
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C{n,k) from the preexisting node n to node k depends 
on the out-degree of the node n and in-degree of the 
target node k. It was demonstrated that when C{n,k) 
is given by a product of two shifted-hnear functions of 
the corresponding degrees, the emergent distributions of 
in- and out-degree are power-law type and statisticaUy 
correlated According to the above rules in Eqs. 

(|l|)-(^), the probability for link creation C(n, fc) in our 
model is C{n,k) — pi{n,i) x p2{k,i), which is exactly 
the type of function compatible with a double-power law 
distributions for out- and in-degrees, in agreement with 
numerical results in Fig. 1. Emergence of statistical cor- 
relations between in- and out-degree distributions is dis- 
cussed in Ref. |lo|. The model of Ref. is slightly 
different from ours, involving three parameters that can 
not be reduced to a single control parameter, making it 
difficult to extract an exact value of the exponent Tout 
in terms of our control parameter /3 (or a). The ob- 
served behavior shown in Fig. 1 suggests that Tout hi- 
creases approximately linearly with a for 0.1 < a < 0.5 
(i.e., 9 > /3 > 1). However, Tout increases rapidly in the 
region below /3 ^ 1/2, suggesting that the distribution 
of out-degree becomes exponential when the rigidity of 
the graph increases towards a finite critical value. Note 
that in the ideally rigid graph /3 = the out-degree dis- 
tribution is trivial: each node has exactly M links that 
remain fixed in time. 

Study of the distribution of connected components 
done in Ref. Q suggests that for P larger than some 
critical value f3 > (3c{N) a giant connected component 
occurs, similar to the real Web By decreasing the 
control parameter (3 the network structure changes grad- 
ually, eventually undergoing the phase transition into a 
structure without a giant component pO| ]. The critical 
value of /3 depends on the network size N and in the cases 
studied here it is close to /3c ~ 1/12. Loss of scaling in the 
out-degree distribution at 1/3 > /? > f3c{N), while the 
in-degree still exhibits scaling behavior, demonstrates the 
power of cooperation in the network: Although the rules 
(^ and (^) formally look alike, the dynamical variations 
in Qoutin^i) arc due to local force, whereas the increase 
of Qinik, i) with time is made by a collective effect. Con- 
sequently, certain dynamical processes which are related 
to the out-degree structure might change their character 
before the network becomes rigid. Next we study random 
walk processes on this class of graphs. 

III. RANDOM WALKS WITH VARIABLE 
STRATEGY 

We define two types of the random walks: a standard 
random walk, and a walk that learns its strategies from 
the information stored at a visited node on the graph, as 
defined below. First we grow the graph of N nodes using 
the rules in Eqs. (E])-(ph, and then start a walk from a ran- 



domly selected node, say node n. In the simple case, here 
called a naive random walk (NRW) for the reason to be 
clear soon, the walker moves along one of the qout{n, N) 
outgoing links of that node, selecting the link with equal 
probability 

w{n) = l/qout{n) , (4) 

where we write qout(n) = qoutin, N), assuming for sim- 
plicity that the network does not grow during the walk 
time. In this way the walker selects a target node, say 
fc, and moves there making one time step of the walk. 
Note that this standard random walk on the graph of the 
structure given in Eq. (|^) is more complex compared to 
the case of hierarchical graphs with a constant branching 
ratio, in that it moves in an environment with variable 
structure of the relevant out-degree. An adaptive random 
walk (ARW), on the other hand, makes move selections 
with the statistical weight, which is correlated with the 
linking strategies of the visited node. In this case we as- 
sume that a link i from node n to node fc has a weight 
defined by 

we{n) ^ p2(fc, N) , J:l2f"'^we{n) = 1 , (5) 

where p2{k,i = N) is given in Eq. (|^) with the normal- 
ization indicated in Eq. (|^). Hence, the adaptive random 
walker uses the same type of strategy that was used ear- 
lier by the visited node, thus moving preferably along 
"hot" links of the visited node. Note that the probabil- 
ity wi{n) is not identical to p2{k,i) both because it is 
evaluated at a later time and it is normalized. In this 
way, the adaptive walker exploits full information about 
local graph structure, which is done by the out-degree 
of the visited node and in-degrees of all with that node 
connected target nodes The naive random walker, 

on the contrary, uses only the first part of information. 
As a quantitative measure of different move strategies 
it is useful to consider the first-step statistics We 
show in Fig. 2 the comparative statistics of the first jump 
of an ensemble of Na walkers with the naive and adap- 
tive strategies, respectively, simulated on the same graph 
and using the same set of random numbers. It is shown 
in Fig. 2 that an adaptive search of the direction by the 
first jump is guided by the graph structure: the slope 
of the distribution of the first-jump distances (measured 
in node ranks) resembles the in-degree distribution. For 
the ensemble of this size the out-degree distances made in 
the first jump are correlated with the in-degree distances 
in view of Eq. (|^). In the random search the distribu- 
tion is still a power-law, however, the graphs structure 
is much less recognized (slope of the distribution of the 
first jumps is by one lower than the in-degree distribu- 
tion of the graphs). Also much weaker, if any, correla- 
tions between in- and out-degree distances are observed. 
The walker continues as long as it is visiting nodes with 
nonzero number of out-links Qout > 0. 
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A. Structure of connected subgraphs 



IV. SURVIVAL AND ACCESS TIME OF THE 
WALK 



A non-interrupted walk scans a set of connected nodes 
on the graph. The set of visited nodes is thus a con- 
nected subgraph smaUer than a connected component 
that is usuaUy searched by the Web crawl An 
ensemble of random walkers thus can be used to scan the 
local structure of connected subgraphs, which in principle 
differs from the global graph structure. 

The "distance" traversed by the walker on the graph is 
best measured in the node-rank differences, i.e., distance 
in the levels of hierarchy, in which the graph structure 
is nontrivial. Spatial distribution of nodes is, in princi- 
ple, random, whereas the temporal fractal structure pc| ] 
occurs on the growing time scale. In Fig. 3 we show 
the time-integrated probability distributions of the node- 
rank distances for adaptive random walk on the graph 
with N = 10^ nodes and varying the control parameter 
(3. An ensemble of iV = 20 x 10^ walkers was employed. 
In Fig. 4 the corresponding distributions obtained by the 
ensemble of naive random walkers are shown that are 
simulated in the same conditions as the adaptive random 
walkers in Fig. 3. 

The distributions of connected subgraphs found both 
by the ensemble of adaptive, W{Aq), and the ensem- 
ble of naive, R{Aq), random walkers are power-law type 
(k = out, in): 



R{Aq,) ^ (Ag,) 



(6) 



Distinction between the respective distributions for in- 
and out-degree distances are resembling the underlying 
graphs structure. On the other hand, the difference in 
the scaling exponents, for instance in Sout and pout and 
similarly with 6in and pi„ suggest that ARW and NRW 
are two qualitatively distinct types of processes. Namely, 
both 6 out > 2 and Sin > 2, whereas pout < 2 and 
Pin < 2 indicating that the average distance in the case 
of the naive random walk diverges [ p4[ with Aq oo at 
N —^ oo, whereas the adaptive random walk remains in 
the confined areas-distances, < Aq >< oo when iV — > oo. 
These properties have important consequences, for in- 
stance for the disease spreading psf along the random 
walk path on the graph. 

In the case of ARW the similarity between the 
W{Aqout) and W{Aqin) and the corresponding distribu- 
tions in Fig. 1 in the scaling region is striking. By increas- 
ing the probability a of a link outcoming from the new- 
added node, fast decrease of the distribution W{Aqout) 
in Fig. 3 makes the exponent Sout difficult to measure 
for a > 0.6 . At a crossover value close to /? ^ 1/3 the 
distribution approaches the exponential form. At a = 1 
all nodes have exactly one out-link, rendering this distri- 
bution trivial. 



Next we study the survival probability of a walk and 
the average access time of a walker to a given level of hi- 
erarchy. These properties are relevant for the relaxation 
of the graph and message passing to a given distance in 
hierarchy on the graph, respectively. 

The access time is defined as a number of steps neces- 
sary for a walker to make a given distance here measured 
in the difference of the hierarchy levels of the departing 
and accessed node. In Fig. 5 the average access time nor- 
malized to the size of the ensemble Na is plotted against 
the difference in the hierarchy levels between departing 
and visited nodes for two values of the parameter /3 and 
distances measured both by in- and out-degree. A re- 
markable feature is the power-law behavior of the access 
In general, the scaling form 



time 1 19 



>^ {Aq^)-'-f{t/Aq,) 



(7) 



applies both for adaptive and naive random walks when (3 
is large. However, the exponents 9^, {k stands for "in, A" 
and "out, A" for the adaptive and similarly "in,R" and 
"out,R" for random walk) are both larger than 2 in the 
case of the adaptive search of the destination, whereas 
1 < 0k; < 2 for the naive random walk. Hence, apart 
from the small distances, the average access time of the 
adaptive random walk is much shorter compared to the 
standard random walk. This makes the adaptive random 
walk a good basis for its potential application as an effi- 
cient algorithm |2^ for message-passing to a given level of 
hierarchy. In the case of catalytic reactions, this property 
of the adaptive random walk suggests that in the average 
fewer number of reactions occur along the path before a 
targeted reaction at a given hierarchy level is reached. 
Accordingly, the survival probability, Pg (t) shown in Fig. 
6, represents two different types of relaxation processes 
for large graph flexibility (large P) : a nearly exponential 
relaxation in the case of ARW, and stretch-exponential 
for the NRW, respectively. 

The difference between adaptive and random search for 
the target gradually diminishes with increasing rigidity 
of the graph (i.e., decreasing the degree of rewiring /?), 
making the wandering on the graphs similar in both cases 
when the critical point is approached (3 w (3c{N). In Fig. 
6 we show the probability Ps (t) that a walk survives for 
t steps on the graph, when the control parameter /3 is 
varied. At the critical value (/3c ~ 0.081 for the graph 
sizes used in this simulations), the survival probabilities 
of the two types of walks almost coincide statistically. In 
the limit /3 = 0, i.e., when a = 1 in Eqs. ([^)-(H), each 
node has exactly one out-link, rendering the both walk 
strategies redundant. As we already pointed out, this 
limit corresponds to the graph with fixed links, belong- 
ing to another universality class compared to the Web 
graph that we discuss here. 
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V. DISCUSSION AND CONCLUSIONS 

We have studied a class of directed graphs with vari- 
able wiring diagram caused, for instance, by frequent up- 
dates of the out-links in the world-wide Web while the 
graph evolves. The relevant control parameter that de- 
fines the class is the average ratio of updated vs. fixed 
links, /3 = (1 — a) I a. In the case of the Web /9 is es- 
timated ijl^ in the range 3-4, i.e., to each added link 
in the Web comes in the average 3 to 4 links that con- 
nect preexisting nodes at each time step of the evolution. 
Other members of this class of graphs can be sought in 
the catalytic biochemical reactions, in which nodes are 
substrates (such as ATP, C02,H20, etc.) and links are 
reactions among these substrates [p]|2|jl9| . Since the back- 
ward reactions, although present, are usually driven by 
much smaller rates than forward reactions the bio- 
chemical reactions are represented by directed hierarchi- 
cal graphs, with ATP as a top connected node. The pres- 
ence of catalysts or enzymes selects appropriate reaction 
with a high accuracy. Investigations and potential appli- 
cations of catalytic reactions among complex molecules 
is a great challenge of sciences in the future ||2^. The 
control parameter in this case can be roughly identified 
as the concentration of the catalyst, that can vary de- 
pending on the type of the reactants and/or catalyst. 

Here we investigated within the growth model of Ref. 
I pof how the structure of the out- and in-connections 
of the graph vary with the control parameter and how 
that structure influences the relaxation processes on the 
graph. We summarize the properties that appear as di- 
rect consequences of the flexibility of the graph: 

(1) In addition to in-degree, the out-dcgrce distribution 
appears to be a power-law distribution with a new scal- 
ing exponent; Correlations between out- and in-degree 
spontaneously develop; 

(2) These structural properties of the graphs deter- 
mine the properties of the random walks on these graphs. 
Richness of the doubly-hierarchical connections allows 
us to define various types of the random walk strate- 
gies. Specifically, the adaptive random walker fully uti- 
lizes local information on both in- and out-connectivity 
of a visited node and adapts its moves to follow the node 
linking preferences. On the other hand, a standard ran- 
dom walker makes use of the out-degree of a visited node 
searching only the possible ways out. For large graph 
flexibility the adaptive strategy proves effective in the 
search of connected subgraphs and in reducing the ac- 
cess time to a given hierarchy level. Quick relaxation of 
the graph represented by the ARW path in this range 
of parameter indicates a short list of reactions before a 
targeted reaction occur. 

The dynamic processes on this class of graphs reflect 
the underlying graph structure, leading to a variety of 
scale- free properties with distinct functional dependences 



on the in- and out- node degrees. Summary of all scaling 
exponents for varying flexibility (or rigidity) of the graph 
is shown in Fig. 7. To understand the theoretical basis 
of these dependences an analytical study in terms of rate 
equations of the random- walk dynamics is necessary. 

(3) By increasing the graphs rigidity (reducing degree 
of rewiring /3) the advantage of the strategy "reading full 
information on the way" is lost: Survival of the adaptive 
random walk becomes statistically closer to the one of the 
naive walk strategy; Access time gradually approaches 
the Poisson character; At a critical flexibility /3c 0.1 the 
graph structure undergoes the rigidity percolation transi- 
tion to another universality class characterized with pre- 
dominantly fixed wiring diagram, in which the random 
walk dynamics becomes trivial. 

(4) The other limit /? — ^ cx3, representing the extreme 
flexibility, is formally interesting as a possible course of 
the world-wide Web evolution. In this limit the evolv- 
ing network at each growth stage shares some similarity 
with the static random graphs! We detect certain nu- 
merical instability in the distributions that can be re- 
lated to the changes in the linking probabilities Eqs. 
(|l|)-(^) when a — > 0. After a large number A^i nodes 
are added, these probabilities are A^i-dependent as ~ 
a/{l + a)Ni + l/{l+a)N[^^^^'^'^\ where we assumed that 
maximum degree varies with the network size approxi- 
mately as ~ iVy^"*, (as before, k stands for "in" or 
"out" ) . In the random-graph theory the leading inverse 
linear term of linking probability is compatible with the 
occurrence of cycles (i.e., triangles, squares, pentagons, 
etc.) of all sizes, whereas the additional inverse sublinear 
term introduces admixture of full graphs By let- 
ting a the leading linear term disappears, inducing 
sudden change in the structure of subgraphs — now being 
only full graphs. Now, having ~ 2 for small a leads to 

1 /2 

Pin 1 /A^i J that is compatible with the occurrence of 
fully connected pentagons. Whereas Tout ~3-2.5, leading 
to Pout ~ I/n'I^'^-I/N^^^ allowing appearance of at most 
fully connected squares. This suggests why the exponent 
of the out-degree should stay larger than the one of in- 
degree distribution when a — > 0. Numerical simulations 
suggest (see Fig. 7) that Tout 2.5, whereas t^ 2 in 
this limit. 

Random walk path may serve as a communication 
channel in modeling of packet transport on this class of 
graphs. In addition to channels, the communication pro- 
cesses depend on the properties of packets to be trans- 
ported and of driving rate resulting in load at individual 
nodes. By varying these parameters on a hierarchical tree 
it was shown in Ref. that a continuous transition to 
a congested regime occurs, that exhibits several univer- 
sal features. Looked in this context, our study concen- 
trates on the properties of the communication channels 
only, and we do not specify any details on the character 
of packets. The simulation conditions thus correspond 



5 



to idealized low driving rate below the transition point. 
Apart from the occurrence of cycles (closed loops), the 
Web graph differs from the hierarchical tree in that linked 
nodes are preferably at large distances of hierarchy, in 
contrast to the tree structure where only next hierarchy 
levels are coupled. We have demonstrated that due to the 
complex double-hierarchical structure of the Web graph 
the channel selection can be done using various strategies, 
each of them resulting in a nontrivial statistical proper- 
ties of the channels. How these channel properties would 
influence the communication processes when more realis- 
tic packets and driving conditions are considered remains 
for the future study. 

In conclusion, we have demonstrated that flexible 
wiring diagrams in the class of directed graphs induces a 
number of structural and relaxation properties that are 
crucial both for evolution of these graphs and for design 
of dynamic processes for exploring their structure. 



ACKNOWLEDGMENTS 

This work was supported by the Ministry of Educa- 
tion, Science and Sports of the Repubhc of Slovenia. I 
thank to Vyatcheslav Priezzhev for helpful suggestions. 



[1] 
[2] 

[3] 



J4] 



'Electronic address: Bosiljka.Tadic@ijs.si 

S. H. Strogatz, Nature 410, 268 (2001). 

R. Albert and A.-L. Barabasi, "Statistical Mechanics of 

Complex Networks", Rev. Mod. Phys. (in press). 

P. M. Gleiss, P. F Stadler, A. Wagner, and D. A. Fell, 

cond-mat/0009124 H. Jeong, B. Tombor, R. Albert, Z. 



N. Oltvai, and A. Barabasi, Nature 407, 651 (2000) 

A. Scala, L.A .N. Amaral, and M. Barthelemy, cond- 



[5] 
[6] 
[7] 
[8] 



[9] 
[10] 

[11] 



[12] 
[13] 

[14] 



mat/0004380 



J.M. Montoya and R.V. Sole, 
M. E. J. Newman, Proc. Natl 
S. Redner, Eur. Phys. J. B 4, 



:ond-mat/0011195 



Acad. Sci. 98, 404 (2001). 
131 (1998). 

A. Broder, R. Kumar, F. Maghoul, P. Raghavan, R. Srid- 
har, R. Stata, A. Tomkins, and J. Wiener, Computer 
Networks 33, 209 (2000). 
D. Dhar, Physica A 263, 4 (1999). 



B. Tadic, Physica A 293, 273 (2001); |cond-mat/0011442 . 
Other mechanisms, for instance in the Internet growth, 
may also invo lve local optimizat ion of supply, see A. 
Capocci et al, 2ond-mat/0106084. 

A.-L. Barabasi, R. Albert, and H. Jeong, Physica A 272, 
173 (1999). 

H. E. Stanley, Introduction to Phase Transitions and 
Critical Phenomena, Oxford Univ. Press, (New York) 
1971. 

S.N. Dorogovtsev, J.F.F. Mendes, and A.N. Samukhin, 
Phys. Rev. Lett. 85, 4633 (2000). 



[15] S.N. Dorogovtsev and J.F.F. Mendes, Phys. Rev. E 62 
1824 (2000). 

[16] L.P. Krapivsk y, G. J. Rodgers, and S. Redner, cond- 



mat/0012181 



[17] 
[18] 



[19] 
[20] 



[21] 



[22] 



[23] 
[24] 

[25] 



[26] 



G. Ergiin and G. J. Rodgers, |:ond-mat/0103423 . 
A special type of aiging, fitness and other constraints on 
the microscopic dynamic level are shown to affect the 
emergent behavior in the preference attachment model, 
see discussion in Ref. [^. 



B. Tadic, cond-mat/0104029 



Such a reaction in which the reactants are added with 
a given rate and the products constantly removed was 
proposed recently to study work produced by molecular 
DNA motors, B. Yurke et al, Nature, 406, 605 (2000). 
The actual number of links in the Web exceeds number of 
nodes suggesting that a larger M would be more realis- 
tic. In the model the universal properties of the network 
in the scaling region are not affected when M is varied. 
Technically, in order to simulate large graphs we preserve 
out- and in-degrees at each node from the growth phase 
and search links by once again using the rule in Eq. (jij). 
The potential differences are minimized with increasing 
size of the ensemble. 
V. B. Priezzhev, privat communication. 
The maximum degree scales with the network size qmax ~ 

A different mechanism of desease spreading on hierarchi- 
cal graphs was considered in Ref. R . Pastor-Satorras and 
A. Vespignani, cond-ma t/010202^ 

It was shown recntly that search time scales sublinearly 
with the network size in several other search algorithms 
that utilize local information in a power-law graph with 
symmetric links, see L. A. Adam ic, R. M. Luko se, A. R. 



Puniyani, and B. A. Huberman, |ss.NI/0103016 
J. Keener and J. Sneiyd, Mathematical Physiology, 
Springer, Berlin (1998). 

B. Bollobas, Modem Graph Theory, Springer- Verlag, 
New York (1998). 



mat/0009395 



6 




FIG. 1. Cumulative probability distributions of out-degree 
(top panel) and in-degree (lower panel) of the Web graphs 
containing 5 x 10® nodes for varying rigidity of the graph 
= a/(l - a). Top four curves are for a = 0.0125, 0.125, 
0.25, and 0.5 (top to bottom in both panels), and additional 
three curves in lower panel for a —1, 3, and 12. Line with 
filled circles: Exponential distributions corresponding to the 
case of random selections of source and target nodes. All data 
are log-binned with base 1.1 . Top three curves are moved up- 
wards for better vision. Lines indicate the scaling region on 
each curve. Variation of the slopes with the control parameter 
are discussed in the text. 
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FIG. 2. Distribution Fi{Aqi^) of the distance on hierarchy 
levels A^K (k =out,in) made in the first jump of the adap- 
tive (ARW) and naive random walk (NRW), as indicated, ob- 
tained by an ensemble of Na = 100 x 10"^ walkers on the graph 
of A'' = 10* nodes. Slopes of in-degree first step distributions 
are: 2.15 and 1.15 for ARW and NRW, respectively. 
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FIG. 3. Time-integrated probability distribution W{AqK) 
of distance in hierarchy levels Aq^ made by ensemble of 
Na = 20 X 10* adaptive random walkers on the Web graphs 
of A = 10* nodes for (k =out) out-degree distances (top 
panel) and (k =in) in-degree distances (lower panel). Differ- 
ent curves correspond to the control parameter values /3 =9, 
3, 1, and /3c= 0.081, top to bottom. Solid lines are pawer-law 
fits with the slopes Sout =2.52, 2.75, 3.83, and Sin ~ 2.48, 
2.50, 2.64, and 2.90, respectively, within numerical error bars 
< ±0.06. 
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FIG. 4. Same as Fig. 3 but for the ensemble of naive ran- 
dom walkers and for (3 —3, 1, and 0.081 (top to bottom lines 
in both panels). Power-law fits lead to the scaling exponents: 
Pout = 1.48 and 2.03, and pin ~ 1.22, 1.53, and 1.95, respec- 
tively, within numerical error bars < ±0.08. 
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FIG. 5. Average access time (normalized by number of 
walkers Na) to a hierachy distance Ag„ (k — in, out) of an 
ensemble of the adaptive (left panel) and naive (right panel) 
random walkers for two values of the parameter a = l/{f3+l), 
as indicated. Distance measured in terms of in-degree (open 
symbols) and out-degree (filled symbols) . Slopes of the curves 
top to bottom are: 2.01, 2.41, 2.61, and 3.64 , on left panel, 
and 1.29, 1.51, 1.47, and 1.82, on right panel, respectively. 
Estimated error bars within < ±0.07. 




FIG. 6. Survival probability distribution Ps(t) against time 
steps t for the adaptive random walk (symbols) and respective 
naive random walk (solid lines) for varying degree of rewiring 
13 = 9,3, 1, 1/3, and 1/12 (left to right). 
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FIG. 7. Various scaling exponents ploted vs parameter 
a = l/(/3 ± 1). Filled symbols correspond to the out-degree 
property, and same open symbols — to the corresponding 
in-degree property, see legend and definitions in the text. 
Dashed lines: 2 ± a and 1 ± a. Dotted lines: nonlinear fit 
of Tout and same curve shifted downwards approximately by 
one. Notice that for the distributions of the naive random 
walk we have: pi„ ~ Ti„ — 1 and pout ~ Tout — 1, and for the 
adaptive walk Sout ~ Tout whereas Sin deviates from Tin for 
small a values. 
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